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Fluctuation Properties of Steady-State Langevin Systems 
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Motivated by stochastic models of climate phenomena, the steady-state of a linear stochastic 
model with additive Gaussian white noise is studied. Fluctuation theorems for nonequilibrium 
steady-states provide a constraint on the character of these fluctuations. The properties of the 
fluctuations which are unconstrained by the fluctuation theorem are investigated and related to the 
model parameters. The irreversibility of trajectory segments, which satisfies a fluctuation theorem, 
is used as a measure of nonequilibrium fluctuations. The moments of the irreversibility probability 
density function (pdf) are found and the pdf is seen to be non-Gaussian. The average irreversibility 
goes to zero for short and long trajectory segments and has a maximum for some finite segment 
length, which defines a characteristic timescale of the fluctuations. The initial average irreversibility 
growth rate is equal to the average entropy production and is related to noise-amplification. For 
systems with a separation of deterministic timescales, modes with timescales much shorter than the 
trajectory timespan and whose noise amplitudes are not asymptotically large, do not, to first order, 
contribute to the irreversibility statistics, providing a potential basis for dimensional reduction. 

PACS numbers: 05.40.-a, 05.70.Ln, 92.05.Df 



I. INTRODUCTION 



Recent advances in nonequilibrium statistical mechan- 
ics have investigated fluctuation theorems in a variety 
of contexts The fluctuation theorem quantifies the 
probability of finding fluctuations in nonequilibrium sys- 
tems that violate the Second Law of Thermodynamics. 
Fluctuation theorems take many forms. The formulation 
we will focus on is in terms of the probability of observing 
finite time trajectory segments of a system @, 0). In this 
context, the fluctuation theorem provides a constraint 
that such trajectory segments must satisfy. Here we 
investigate the fluctuations in a nonequilibrium steady- 
state governed by Langevin dynamics. We go beyond 
the fluctuation theorem and study those properties of the 
fluctuations that are not constrained by the fluctuation 
theorem. These properties are not generic. They depend 
on the details of the specific dynamical system, and we 
investigate the relationship between the nonequilibrium 
fluctuations and the parameters defining the Langevin 
dynamics. 

Our motivation for studying specific details of nonequi- 
librium fluctuations comes from work in theoretical cli- 
mate dynamics. In recent years, linear stochastic dy- 
namical systems have been successfully used to model 
many phenomena in the climate system such as El-Nino 
HIE El, the North Atlantic Gulf Stream_0L and a vari- 
ety of atmospheric phenomena H, [i| [l(J flllTl2| . We shall 
refer to these phenomena as climate subsystems in that 
they are often considered to be dynamical systems that 
are separable from the larger climate system, at least on 
some set of spatial and temporal scales. Since these fluc- 
tuations have macroscopic timescales, it is important to 
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investigate the character of individual fluctuations and 
the statistics of their properties. 

In the work on climate subsystems, the focus has been 
on two considerations: the utility of linear stochastic sys- 
tems in forecasting [J, @, [l3| , and the potential for the 
deterministic part of the dynamics to amplify the random 
noise d 0, El El E3] • It is often assumed that the large 
amplitudes of these phenomena requires them to be the 
result of dynamical instabilities. The recognition that 
deterministic dynamics can amplify small noise forcing, 
which in meteorology goes back to Lorenz (l8l | , provides 
an alternative view of such phenomena. This amplifica- 
tion occurs when the deterministic matrix is non-normal 
[Til Il5j . One common critique of the noise-amplification 
view is that non-normality and the resulting amplifica- 
tion depends on the subjective choice of coordinate sys- 
tem, and can be removed by an appropriate coordinate 
transformation. Recently this objection has been an- 
swered by noting that underlying the property of non- 
normality is the more fundamental, coordinate invariant 
property of detailed balance. Linear stochastic climate 
subsystem models share the property that they violate 
detailed balance, and this is what is responsible for the 
noise amplification (l7| . Thus, a wide range of phenom- 
ena in the climate system can be interpreted as fluctua- 
tions in a nonequilibrium steady-state. For climate fluc- 
tuations such as El-Nino, understanding the character 
of the fluctuations is extremely important. Further, due 
to global warming, the steady-state is changing. Under- 
standing how phenomena such as El- Nino will change as 
climate changes is a major uncertainty in climate change 
predictions [19|. Thus, improved understanding of how 
nonequilibrium fluctuations depend on the properties of 
the steady-state could lead to improvements in climate 
change forecasts. 

As a concrete example, we will focus on El-Nino. El- 
Nino is a coupled atmosphere-ocean phenomenon that is 
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centered in the tropical Pacific Ocean and has global im- 
pacts. One key aspect of El-Nino is that the atmosphere 
evolves on a faster timescale than the ocean. The tur- 
bulent dynamics of the atmosphere has a predictability 
limit of about two weeks (2(j. The ocean, on the other 
hand, has timescales of months. Thus, on the monthly 
timescale of El-Nino, the atmosphere is unpredictable 
and can be considered a random forcing [2l| . While this 
parameterization of fast chaos as random noise is typi- 
cally done empirically, there are some theoretical results 

The phenomenon of El-Niho is described in terms of 
the sea surface temperature (SST) of the tropical Pacific. 
Although the SST is a continuous field, both observations 
and models use a finite number N of SST values. Thus, 
the state vector x of the system is an A-dimensional 
vector of real numbers representing the discretized SST 
field. Often, the dimensionality is reduced by truncating 
to some number of leading modes. Typically, the mean 
SST is removed, so x represents the SST anomaly and 
can be positive or negative. A linear stochastic Langevin 
model for El-Niho is then 



dx 

— = Ax 

dt 



(1) 



where A is an N x N real matrix representing the linear 
deterministic dynamics, F is an N x N real matrix rep- 
resenting the noise forcing, £ is N dimensional Gaussian 
white noise, (£(t)£ T (s)} = \6(t— s), where superscript T 
represents the transpose, I is the identity matrix, and the 
diffusion matrix is D = FF T /2. We require the system to 
have a steady-state, which implies that the deterministic 
dynamics is stable, i.e. all eigenvalues of A have a neg- 
ative real part. From a dynamical systems perspective, 
Eq. ([1]) describes a stable linear fixed point perturbed by 
additive Gaussian white noise. Eq. ([1]) is the fundamen- 
tal equation defining the dynamics, and our goal is to 
describe the nonequilibrium fluctuations in terms of A, 
D and matrices derived from them. 

The Langevin dynamics, Eq. (JTJ, describes both equi- 
librium and nonequilibrium steady states, depending on 
whether or not detailed balance is satisfied. For most ma- 
trices A and D, detailed balance is violated and the sys- 
tem has a nonequilibrium steady-state. This is the case 
for Langevin models of climate subsystems. Detailed bal- 
ance requires AD-DA T = 0, and then = A+DQ = 0, 
where Qo is the inverse of the steady-state covariance, de- 
fined explicitly below, while both expressions are nonzero 
when detailed balance is violated. When detailed balance 
is violated, the steady-state distribution po(x) is main- 
tained by a nonzero divergence-free probability current 
j(x) = Qxpo(x), where 0.x is a phase space velocity 
and Q. can be interpreted as a matrix of rotation fre- 
quencies. The probability current is divergence-free, and 
thus Trace(fl) = 0. The system satisfies detailed balance 
if and only if there exists a coordinate system where A 
and D are both diagonal. Thus systems described by 
Eq. (TTJ) in detailed balance can be transformed into a 



collection of uncoupled one-dimensional systems, while 
those violating detailed balance have an essential multi- 
dimensional character. 



II. THE FLUCTUATION THEOREM 

The fluctuation theorem can be written in terms of the 
probability of observing trajectory segments. Consider a 
long trajectory x and choose a time interval t. For any 
two states x and xi, we define the trajectory probabil- 
ity p(x 0l X\,t) as the probability of finding a trajectory 
segment within the long trajectory that begins at Xq and 
ends at X\ a time t later. This definition differs from 
the trajectory probability used in some previous studies 
3, 26] in that it depends only on the endpoints of the 
trajectory segment and not on the full trajectory. By 
relying only on the endpoints of the trajectory segment, 
this definition may be better suited to discretely sampled 
data, such as found in climate records. 

The time-reversed trajectory segment, one starting at 
Xi and ending at xq, has a probability p(xi, xq, t). For 
simplicity we shall drop the dependence on the time in- 
terval t when it causes no confusion. The irreversibility 
r{xo,X\,t) of a trajectory segment with initial state Xq 
and final state X\ is defined by 



r(xo,xi) = In 



p(X!,X Q )' 



(2) 



Thus, r = says that one is equally likely to find for- 
ward and reverse trajectory segments and the system is 
reversible, while r ^ says that one can distinguish for- 
ward from reverse trajectories segments. The statistics of 
r over a long trajectory corresponds to the intuitive no- 
tion of irreversibility: they quantify how well one is able 
to distinguish a long trajectory from the same trajectory 
going backwards in time. 

The fluctuation theorem is now a direct result of the 
definition of r [3]. Eq. ((2|) implies that r(a;i,Xo) = 
-r(a;o,a;i), and p(x ,x 1 ) = exp(r(x ,xi))p(xi,x ). 
Then the probability p r (r) of finding a trajectory seg- 
ment with irreversibility r is 



p r (r) = J d N x Q d N x 1 p(x Q ,x 1 )S(r(x Q ,x 1 ) - r) 

xp(x 1 ,x )5(r[x 1 ,x ) + r) 
= e r Pr (-r). (3) 

The final line in Eq. §5§ is the fluctuation theorem relat- 
ing the probability of finding positive and negative irre- 
versibilities. The fluctuation theorem thus puts a con- 
straint on p r (r), but does not completely determine its 
functional form. 
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III. THE IRREVERSIBILITY OF TRAJECTORY 
SEGMENTS 

For the linear stochastic Langevin dynamics, Eq. 
the probability of finding a trajectory segment with a 
given irreversibility p r {r) can be written in terms of the 
basic parameters of the dynamics. We begin by defin- 
ing two more traditional probability distributions: the 
steady-state probability po(x) of finding the system in 
state x, and the transition probability p(x\ 1 t\xo) of find- 
ing the system in state Xi conditioned on the system be- 
ing in state x a time t earlier. The trajectory probability 
is then 



p(x Q ,xi,t) = p(xi,t\x )po(x ). 



(4) 



Because the system is linear with additive Gaussian white 
noise, these probabilities are also Gaussian and can be 
explicitly written in terms of the covariance of the dy- 
namics. 

A stochastic trajectory of Eq. fl| starting at a;(0) can 
be written as 



x(t) = e At x 



Jo 



(5) 



Since we only consider additive noise, the above inte- 
gral is the same in both Ito and Stratonovich interpre- 
tations. The time-dependent covariance matrix Cf for 
Ax = x 1 —cxp(At)x , the difference between the stochas- 
tic trajectory and its deterministic counterpart is 



(Ax Ax ) 
= 2 / e A (*-s)De AT (*- s ) 



(6) 



U 



and the steady-state covariance Co = lim^oo Ct satisfies 
the relation 



AC + C A T + 2D = 0. 



Writing Co as 



Co = 2 



dse' As De- A * 



allows one to obtain the useful relation 

At/- A T t r r 

e C e = Co - C t . 



(7) 



(8) 



(9) 



Define the inverse covariance matrices, sometimes called 
the concentration, by Q t = C^ , Qo = Cjj" 1 . 
The steady-state probability is 



p (x) = A" exp[-a; T Qoa;/2], 



(10) 



with normalization Afo = 1/ \J (2n) N Det(Co). The tran- 
sition probability is 



p(£Ci,t|a:o) = Af t exp[-Ax T Q t Ax/2], 



(11) 



where the normalization is Aft = (2ir) N Det(Cf). 
The transition probability is thus a Gaussian distribu- 
tion with covariance Ct distributed around the endpoint 
of the deterministic trajectory segment beginning at Xq. 

The trajectory probability depends on both the ini- 
tial and final states. We thus consider a 2A-dimensional 
state-space 



(12) 



The forward trajectory probability is Gaussian and is 
given by 



p(x ,xi) = Af cxp[-z T R iz/2], 



(13) 



with normalization Af = l/[(27r) JV Ak /Det(CoCt)], and the 
concentration of the trajectory probability Roi is the 
2N x 2N matrix 



Rqi _ , e ATt Q t e At + Q -e* Tt Q t 



Qte At Qt 

The reverse trajectory probability is 

p(x 1 ,x ) = Af cxp{-z T R 10 z/2], 



(14) 



(15) 



where the concentration of the reverse trajectory proba- 
bility is related to that of the forward trajectory proba- 
bility by swapping initial and final states: 



Q t e At 



RlO — JRoiJ — ( A T 'tr> A T tr\ At , r» ) ' 



with 



I 

1 



(17) 



and I is the N x N identity matrix. 

The irreversibility r is now simply obtained from Eq. 
@, r(z) — z T Rz/2 with the irreversibility concentration 
matrix R = Rio — Roi- One can show that when detailed 
balance is satisfied, the irreversibility concentration ma- 
trix R is identically zero and the system is reversible. 
The irreversibility can be be described by the eigenval- 
ues and eigenvectors of R. A 2iV-dimensional eigenvec- 
tor v n with eigenvalue A„ can be written in terms of an 
TV-dimensional initial endpoint v n o and TV-dimensional 
final endpoint v n i, — {Vno, v ni)- Due to the struc- 
ture of R, each eigenvector has a corresponding time- 
reversed eigenvector with reversed endpoints, {v^i,v^ ), 
with eigenvalue — A n . 



IV. THE IRREVERSIBILITY DISTRIBUTION 

The probability density function of irreversibility p r (r) 
can be obtained in terms of its characteristic function 
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Pr(k) 



p r (k) = (e* kr ) = / dre lkr p r (r) 



Pr(r) = ^ / dke- ikr p r {k). 



(18) 



Using the result from the previous section, the irre- 
versibility pdf can be written as 

p r (r)= J d 2N z5(r - z T Rz/2)p{x () ,x 1 ). (19) 

Writing the delta- function in terms of its Fourier trans- 
form 5(r) — l/{2n) J dk exp[ifcr], changing the order of 
integration, and comparing with Eq. (|18|) gives the char- 
acteristic function 



p r (k) = TV / d 2N z exp[-2 T (R i - ikR)z/2}. (20) 



Since R is symmetric and Roi is positive definite, the 
above expression can be simplified using the dual con- 
junctive diagonalization [27j . This diagonalizes the ma- 
trix in the exponential, transforming the expression into 
a product of one-dimensional integrals that can be easily 
carried out. Define the matrix W = Rq/R, define the 
matrix S _1 to be the matrix of eigenvectors of W, and 
define the diagonal matrix A to be the matrix whose ele- 
ments are the 2N eigenvalues of W, A„. Then Roi = S T S 
and R = S T AS and Eq. (|20|) can be integrated to obtain 
the characteristic function of the irreversibility pdf 



Pr(k) 



1 



v /Dct(l 2Ar - ikl\) n;=i VI - ikXn 



(21) 



where we have made use of the fact that 
Det(Roi) Det(CoCt) = 1. Thus, the characteristic 
function depends on the eigenvalues of W. 

The covariance of the the forward trajectory proba- 
bility Rq! 1 , needed to compute W, can be written in a 
relatively simple form using Eq. ([9]) 



Co 
; A *C 



C e AT 
Co 



(22) 



We have thus obtained a closed-form expression for 
p r {k) in terms of the eigenvalues of W, which is an 
explicit function of the deterministic dynamics A, the 
steady-state and finite-time covariance matrices Co and 
Ct, and their inverses. The covariance matrices depend 
only on the deterministic dynamics and the diffusion ma- 
trix. The full pdf of irreversibility is then obtained by 
integrating Eq. Q18p using Eq. (|2"Tj) . No closed form so- 
lution for the integral has been found. 

The eigenvalues of W have an interesting interpreta- 
tion. In the coordinate system z — Sz, the trajectory 

probability p(z) ~ exp \z\ 2 /2^j, and the irreversibil- 
ity is r = J2i A$z?/2. Thus, the eigenvalue A, of W gives 



the irreversibility weighting for coordinate i in a coordi- 
nate system where the trajectory probability is isotropic 
and has unit covariance. 

The moments of the irreversibility pdf can be obtained 
by considering the cumulants of the pdf [28J . The cumu- 
lant function g(k) = logp(fc) is 



g(k) 



2N 



ik\ n ), 



(23) 



n=l 



and the cumulants are then 



d m g{k) 



dk r 



k=0 



(to- 1)! 



Trace(W' m ). 



(24) 



Using the relationship between cumulants and centered 
moments gives the moments of the pdf. The first four 
centered moments arc 



((r- 
((r- 
((r- 



(r) 

(r)f) 
(r)f) 



Trace(W), 
Trace(W 2 ), 



Trace(W 3 ), 
3Trace(W 4 ) 



• Trace 2 (W 2 ). (25) 



The irreversibility pdf is not, in general, Gaussian. The 
distribution is skewed and has kurtosis different from 
the Gaussian value. Such non-Gaussian distributions 
have been previousl y se en in a variety of nonequilibrium 
systems. [23, [13, tHHH}. Considering the definition of r, 
Eq. ([5]), and writing moments of the irreversibility as 



= J d N x d N Xi r n (x , xi)p(x ,xi), 



(26) 



one sees that all (non-centered) moments are non- 
negative. The average irreversibility can be simplified 
to 



(r) = Trace(C Q t (l 



2Ai\ 



I). 



(27) 



It is interesting to consider how the irreversibility 
scales with the strength of the noise. Consider taking 
a system and increasing the diffusion matrix by a con- 
stant factor a. Then the covariance matrices increase by 
a, and the concentration matrices are scaled by 1/a. The 
irreversibility for a segment with fixed endpoints scales 
by 1/a, but since the covariance scales by a, the prob- 
ability of finding those endpoints scales. As a result, 
the irreversibility pdf is unchanged by the scaling. Note 
that this invariance is only valid for multiplication by a 
scalar. A matrix transformation of the noise will, in gen- 
eral, change the dynamics and the irreversibility. The ir- 
reversibility is coordinate invariant, so we are free to con- 
sider any convenient coordinate system. If one considers 
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a coordinate system where D is diagonal, obtainable by 
an orthogonal transformation, then the system can be 
considered to be coupled to N thermal reservoirs with 
temperatures given by the eigenvalues of D. Then the 
irreversibility statistics are unchanged by changing the 
temperature of all heat baths by a constant factor. Fur- 
ther, if one considers the coordinate system where D = I, 
obtainable by a non-orthogonal transformation, then the 
system can be considered to have all N degrees of free- 
dom coupled to a single thermal reservoir with unit tem- 
perature. This coordinate system makes explicit the fact 
that all coordinate-invariant properties, including the ir- 
reversibility, are independent of the temperature of this 
single reservoir. Thus irreversibility is neither a measure 
of the temperature of the reservoir, nor a measure of the 
amplitude of the fluctuations, but rather is related to the 
amplification of the noise above that seen in equilibrium. 



V. TIME DEPENDENCE OF AVERAGE 
IRREVERSIBILITY 

The time dependence of the average irreversibility 
gives information about the time dependence of the fluc- 
tuations. Because the dynamics is stable, the follow- 
ing properties hold: the eigenvalues of A all have neg- 
ative real part, lim^oo e At = 0, lim^oo Q t — Co, and 
limt^oo Q t = Q . Thus, Eqs. and Q2J) give 



coupled to the system over a time t is, in our notation, 



lim Rp 



lim Ri 



Qo 







Qo 



(28) 



This is easily understood in that as the time becomes 
large, the initial and final states become uncorrelated and 
the trajectory probability is merely the product of the 
steady-state probabilities of the initial and final states. 
As a result, lim^oo R = 0, and the irreversibility of long 
trajectory segments goes to zero. 

For short times t — t -C 1 , one can use the asymptotic 
expansion for e Ar to obtain expressions for C r and Q r . 
This allows one to write the average irreversibility as 



(r) = — Trace 



AC (a t D^ 1 



D X A] 



)]+0(r 2 ). (29) 



Thus, as t — > 0, (r) — ► 0. Further, for short times the 
dependence of (r) on the violation of detailed balance, 
which is equivalent to A T D 1 — D X A ^ 0, is manifest. 

Thus, the average irreversibility is positive semi- 
definite for all time and goes to zero as t — > and t — > oo. 
This means that either (r)(t) = for all t and the sys- 
tem is in equilibrium, or there is a time t* where the 
average irreversibility reaches a maximum. This defines 
a characteristic timescale of the irreversible fluctuations. 

Fluctuation theorems are often formulated in terms of 
the entropy production Chernyak, et al., [I| speculate 
that for multi-dimensional systems such as Eq. ((T|), the 
time average entropy increase in the thermal reservoirs 



E t = - / dx J D 'O.r. 



(30) 



where the integral is interpreted in the Stratonovich 
sense. Using the equation of motion Eq. (fTJ) to write 
dx in terms of dt and taking the average one obtains 

(E t ) = - / ds(x T (s)A T D- 1 Qx(s)) 
t Jo 
i rt 

+ - / ds(^ T (s)F T D- 1 nx{s)). (31) 
t Jo 

The first term is simplified by considering x(s) to be 
in the steady-state so (xi(s)xj(s)} — Co ir The second 
term can be simplified to Trace(Q) = 0. Manipulating 
the result using the definition of Q and Eq. ([7|) one finds 
that the average steady-state rate of entropy production 
is identical to the zero-time growth rate of the average 
trajectory irreversibility given by Eq. (|29p . 



<£*> = 



d(r)(t) 



dt 



(32) 



The entropy production can be related to the noise am- 
plification that occurs when detailed balance is violated. 
First consider one-dimensional dynamics governed by de- 
terministic dynamics A < 0, diffusion constant D > 0, 
and steady-state covariance Co > 0. Then Eq. ([7]) gives 
— (ACq/D + 1) = 0. The negative sign is chosen so that 
amplification will correspond to a positive number. If, 
through some additional forcing, the covariance were in- 
creased to C > Co, then one measure of that additional 
amplitude is —(AC'/D + 1) > 0. In multi-dimensional 
systems, increased variance occurs not through some ad- 
ditional forcing, but through violation of detailed balance 
(r7| . One analogous measure for noise amplification is the 
nondimensional gain matrix G = — (ACoD -1 + 1). Using 
Eq. |(7J) allows one to write E t as 



(Et) = Trace [AG] . 



(33) 



The entropy production rate has units of 1/time, and 
the timescale of the system is set by the deterministic 
dynamics A, Thus, AG is a matrix measure of the noise- 
amplification per unit time, whose trace gives the steady- 
state rate of entropy production. 



VI. REDUCTION TO SLOW MODES 

Complex spatio-temporal systems are typically high- 
dimensional systems with a wide range of time-scales. 
One often would like to reduce the system down to a 
more manageable number of degrees of freedom. There 
are several common truncations but none are entirely sat- 
isfactory. Here we explore dimensional reduction based 
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on a separation of timescales and examine the effect on 
irreversibility. 

We have already seen that for times longer than 
the longest deterministic timescalc the irreversibility be- 
comes zero. It is thus not unreasonable to hypothesize 
that those degrees-of-freedom whose timescale is much 
shorter than the timespan of a trajectory segment will 
have no affect on its irreversibility. If this were the 
case, then in considering the irreversibility of trajec- 
tory segments of a particular timespan, one could reduce 
the dimensionality to those degrees of freedom whose 
timescales are similar to or longer than the segment 
timespan. We now show that when there is a separation 
of timescales in the dynamics this is indeed the case and 
the fast modes have a small effect on the irreversibility 
statistics. 

Climate subsystems often have slow modes which com- 
prise a reduced dimensional subspace. Here we shall in- 
vestigate the consequences of the deterministic dynamics 
having a separation of timescales. Note that by model- 
ing the system as an iV-dimensional stochastic dynamical 
system we have already assumed a separation into N slow 
modes, considered to be deterministic, and unresolved 
fast modes which are parameterized as random noise. 
Now we decompose the slow deterministic modes into 
slower modes and faster modes. The faster modes are fast 
compared to the slower modes, but still slow compared 
to the random noise. More specifically, assume that the 
N eigenvalues A^ of A can be divided into two groups, 
N s slow modes and Nt — N — N s fast modes where 
Re(X' i ) ~ 0(1) for 1 < i < N s , and Re{X' i ) ~ 0(l/e) for 
N s < i < N , and e< 1. Further, we restrict ourselves to 
times t that are order one, so that Re(X'j ast )t ~ 0(l/e). 
We shall rescale the fast eigenvalues so that the small 
parameter is explicit, X s i ow = X' alow , Xfast = A^ QSt e, and 
the real parts are all O(l). 

We will work in a coordinate system where A is diag- 
onal: 



A, 
A f /e 



(34) 



where A s is a diagonal matrix of slow eigenvalues and 
Af is a diagonal matrix of scaled fast eigenvalues. Since 
the eigenvalues will typically be complex, the coordi- 
nate transformation is also complex. The various equa- 
tions presented above must then be modified by chang- 
ing transpose operators to adjoint operators, indicated 
by f . For more details on coordinate transformations in 
stochastic linear systems see [13] ■ In these coordinates, 
the state space variable x can be decomposed into slow 
variables y and fast variables w: x^ = (y\vji). 

In these diagonal- A coordinates, the covariance matrix 
can be obtained by direct integration of Eq. ^ to obtain 



2D tJ 

t%3 K + K* 



[exp((Aj + A?)i)-l] 



(35) 



where star denotes complex conjugate and the eigenval- 
ues are unsealed. For order one times, exp(A^ ast i) ~ 



exp(— l/e) w and the deterministic Green function is 

s A s t Q 







(36) 



Then the covariance matrices take the form 



C_ / *~tyy E^*Oyw 



where the subscripts y/w indicate fast/slow modes, 
the subscripts t/0 indicate whether the covariance sub- 
matrix is time-dependent or steady-state, and all sub- 
matrices are O(l). Thus, the time-dependent covariance 
matrix is decomposed into an 0(1) slow-slow covariance 
which depends on time, and its complement which is 
small and equal to the steady-state value. Note that this 
analysis assumes that all components of the diffusion ma- 
trix D are O(l). It may be the case that the fast modes 
have larger noise than the slow modes. If the noise in 
the fast modes is 0(l/e) then this asymptotic expansion 
breaks down. 

Using this decomposition in the equations leading to 
R and W, and making frequent use of matrix identities 
for block matrices leads to the following results. For any 
given trajectory segment with endpoints x^ — (yt,wl), 
x \ = (y\, w i)i the irreversibility z^Rz depends on both 
the fast and slow variables. On the other hand, the char- 
acteristic function for the irreversibility pdf depends to 
first order only on the slow variables. Thus the statis- 
tics of the irreversibility are, to lowest order, unaffected 
by truncating the fast variables. These two results may 
seem contradictory. However, the fast eigenvalues have 
two effects: the correlations decay rapidly and, as seen 
in Eq. (|3T|) . the covariance of the fast modes is small. 
Thus, the typical size of the fast variables is small and 
its contribution to the irreversibility is a higher-order ef- 
fect. While large rare fluctuations in the fast modes do 
effect the irreversibility of isolated trajectory segments, 
they do not, to lowest order, impact the statistics. Thus, 
in considering irreversibility, and provided the diffusion 
matrix is O(l), one can safely neglect fast modes and re- 
duce the dimensionality of the dynamics to just the slow 
modes of the system. 



VII. 



DISCUSSION 



Fluctuation theorems in nonequilibrium systems have 
focused attention on the irreversibility of trajectory 
segments, and provide a constraint for their distribu- 
tions. Theories of climate subsystems provide motiva- 
tion for analyzing the nonequilibrium fluctuations of lin- 
ear stochastic dynamical systems in more detail. Here we 
combined these two perspectives and obtained informa- 
tion about the trajectory irreversibility that is not con- 
strained by the fluctuation theorem. 

For linear stochastic dynamics with additive Gaussian 
white noise, the irreversibility was shown to be governed 
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by an irreversibility concentration matrix R which is ex- 
pressed in terms of the fundamental matrices governing 
the dynamics. The moments of the irreversibility pdf 
can be written explicitly and the pdf is seen to be non- 
Gaussian. For nonequilibrium steady-states, the average 
irreversibility grows from zero as the trajectory times- 
pan increases, with the initial growth rate being equal to 
the average entropy production rate, which is related to 
the noise-amplification. In nonequilibrium steady-states, 
there is a finite time where the average irreversibility is 
maximal, and it decays back to zero as time goes to in- 
finity. For a system with a separation of timescales in the 
deterministic dynamics and without asymptotically large 
noise in the fast modes, only the slow modes contribute to 
the irreversibility statistics, while modes faster than the 
trajectory timespan contribute higher order corrections. 
There is, however, evidence that in at least some climate 
subsystems the noise in fast modes is indeed large, and 
thus this approach to dimensional reduction may not be 
applicable 0, [H[ . 

It is important to note that the irreversibility depends 
the multivariate nature of both the deterministic dynam- 
ics and the random noise. Nonequilibrium, the violation 
of detailed balance, and the non-commutivity relation 
AD — DA T =^ are all equivalent, and determining the 
irreversibility requires knowledge of both parts of the dy- 
namics. 

These results were obtained in the idealized context of 
a linear dynamical system forced by additive Gaussian 
white noise. However, the definition of the irreversibil- 
ity and the constraint provided by the fluctuation the- 
orem are general. Thus, one can ask similar questions 
about the distribution of irreversibility in more complex 
systems. It remains to be seen which of the above re- 
sults generalize. In the context of climate, the fact that 
many climate subsystems can be modeled by such simple 
stochastic dynamical systems indicates that the proper- 
ties obtained here are at least approximately valid for 
these climate subsystems. Further, even for climate phe- 
nomena that are not well-approximated by such simple 
models, the behavior of these models provides a null- 
hypothesis for the phenomenon. 

Fluctuations in climate subsystems are complex, multi- 
dimensional phenomena with many characteristics. It is 
often convenient to reduce this behavior down to a single 
scalar, referred to as an index. These indices are usually 
based on subjectively chosen phenomenological features 
of the fluctuations. For example, one common index used 
in El-Nino studies is the NIN03 index, defined as the 
mean sea surface temperature anomaly from climatology 
over the region 5°N-5°S, 90°W-150°W [34]. Different 
indices capture different aspects of a phenomenon, and 
if the character of the phenomenon changes as climate 
changes, then any particular index may lose its utility. 

The irreversibility provides an interesting alternative 
to traditional indices. Like an index, irreversibility is a 
scalar defined in terms of the time series of the system. 



However, unlike traditional indices, the irreversibility re- 
flects fundamental properties of the nonequilibrium dy- 
namics. The timescale of climate phenomena is often 
understood in terms of the specific physical properties of 
the system of interest. El-Nino timescales, for example, 
involve the time for waves to propagate across the trop- 
ical Pacific Ocean. Other timescales such as the growth 
rates of perturbations based on singular vector analysis, 
depend on the subjective coordinate system used. By 
virtue of its coordinate independence, the time of maxi- 
mum average irreversibility provides an objective choice 
for a fluctuation timescale. 

A major obstacle to the practical use of irreversibility 
is that its direct measurement from Eq. ^ will require 
extremely long timeseries. In order to compute r directly 
from a timeseries, one must quantify the probability of 
finding rare events, which means one must have a time se- 
ries long enough to contain those rare events. Even with 
the long timeseries produced by numerical models, direct 
computation of the irreversibility may be prohibitive for 
all but the very simplest models. There are techniques 
that have been used to accelerate nonequilibrium com- 
putations, but it remains to be seen if these techniques 
can be applied to climate models. The most promising 
avenue may be to use climate timeseries to estimate the 
parameters of the linear stochastic model in Eq. (TT]). This 
is the technique used, for example, in constructing linear 
inverse models of El-Nino Q. Then, the irreversibility 
could be computed using the expressions obtained here. 

In many climate subsystems the phenomena modeled 
here by stationary random noise have a strong seasonal 
component. A better stochastic model for these phe- 
nomena would then be cyclostationary noise. Additional 
complexities to be considered are red-noise processes and 
multiplicative noise processes. All of these modifications 
will probably impact the results obtained here. 

As climate changes, the nonequilibrium steady-state 
changes. Many climate subsystems have timescales 
shorter than the timescale for climate change, and the 
change in the steady-state can be considered to be adi- 
abatic. By obtaining relations between the parameters 
defining the steady-state and the fluctuations, we have 
solved part of the question of how climate subsystem 
fluctuations will be affected by climate change. The ques- 
tion of how the steady-state itself evolves under climate 
change remains. However, it may be possible that cli- 
mate models do a better job of capturing the evolving 
steady state than the fluctuations. If so, this work may 
lead to improved climate change forecasts. 
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